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ABSTRACT 
teachers who are 



This report analyzes computer usage in the classrooms of 
at least moderately well-prepared in the use of computers 



for reading instruction. Data from the 1998 National Assessment of 
Educational Progress (NAEP) database were used to analyze the influence of 
computers on academic achievement. The NAEP, which is administered in 4th, 

8th, and 12th grade, provides test scores as well as background information 
on students, their teachers, and their school administrators. This analysis 
considered the effect of computers in the classroom by analyzing six factors: 
frequent in-class computer use by trained teachers; race and ethnicity; 
parents' educational attainment; number of reading materials in the home; 
free or reduced-price lunch participation; and gender. Results indicate that 
students with at least weekly computer instruction by well -prepared teachers 
do not perform any better on the NAEP reading test than do students who have 
less or no computer instruction. Variables such as race, income, home 
environment, and parents' college attendance are all significant factors in 
explaining differences in reading test scores. Girls score slightly higher 
than boys on the NAEP reading exam in 4th and 8th grade. An appendix presents 
results of the statistical models. (SM) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 






A Report of 

The Heritage: Center 

For Data Analysis 



mmmmmtmmlmmmmm 



Do Computers in the 
Classroom Boost 
Academic Achievement? 

Kirk A. Johnson, Ph.D. 

CDA00-08 J une 1 4, 2000 



%Z 



c Hefitage^oundatioii 




:r&Z3aWX>?msm&& HblfeKtiKSW:* vw 



: :: vaassse .* , 



ERiCl 



BEST COPY AvAilAT 






A Report 

of The Heritage Center 
for Data Analysis 



Do Computers in the 
Classroom Boost 
Academic Achievement? 

Kirk A Johnson, Ph.D. 

CDA00-08 June 14,2000 




Hetitage G Foundatioii 



214 Massachusetts Avenue, NE Washington, DC 20002 (202)546-4400 www.heritage.org 



NOTE: Nothing written here is to be construed as necessarily reflecting the views of The Heritage Foundation or as 
an attempt to aid or hinder the passage of any bill before Congress. Q 



THE HERITAGE CENTER FOR DATA ANALYSIS 



HOW TO INTERPRET THESE FINDINGS 

■' • -Zf*:’:* ; •" ' ‘ 

This report contains the results of statistical tests that use NAEP data to explain differences in read- 
ing test scores. These statistical tests isolate the independent effects of a number of factors on reading^, 
scores (such as the education of parents) in order to determine whether computer use at least weekly 
matters to these test scores. The statistical tests (or correlations) cover data on a wide array of school 
children, as defmed by their race, income, and other socioeconomic characteristics. Because the statis- 
tical model used here includes these socioeconomic characteristics, the reader can interpret these find- 
ings as applicable to each of these groups of students. Thus, the findings about computer use and 
reading scores apply as much to upper-income as to lower-income students, to blacks as to whites, to 
girls as to boys, and so forth. - ' ’ • , : 

These correlations suggest that there is a statistical relationship between the factor and achievement 
in reading, but they do not suggest that these independent factors cause differences in academic 
achievement. - 'igrS'r i.. : . .d&i '• 

The variables in the model came from the NAEP database and do not include everything that might 
have an effect on academic achievement, such as the methods used to teach reading. These factors may 
be much more important in general, or for a particular child, than the factors recorded in the NAEP * 
data. Moreover: 

Some variables, such as participation in the federal free and reduced-price lunch program, are 
proxies (substitutes) for other unobserved factors. For example, eligibility for the free and 
’ ; reduced-price lunch program is determined by income; only children from low- income families 
may participate. Although not all low-income children will participate in the free and reduced- 
price lunch program, many will. Such information may be used, then, to analyze the effect of dif- 
ferent characteristics on achievement. 

• Some variables also may be used to determine the effect of some unobservable “third factor.” For 
t example, this model does not suggest that poor families have children who do worse on the NAEP 

because they are poor. Rather, poor families may have some unobservable characteristics or chal- 
lenges that make it more difficult to succeed in school. Similarly, the categories of black and 
Hispanic students cover children whose characteristics other than their race may make it more 
difficult for them to score well. 

• “Statistically insignificant" means that the effect of the variable/factor is no different from zero 
effect. For example, if the relationship between computer use at least weekly and academic 
achievement is statistically insignificant, that means that those students who use computers at 

b; least weekly do no better than those who do not. ; ! 



capabilities. Many early studies of computers in 
elementary educational settings employed highly 
trained educational researchers rather than ordi- 
nary teachers. Their advanced training and experi- 
ence may have facilitated the learning process, 
making the effect of the computers alone difficult 
to ascenain. 9 Those studies suggest that students 



who use computers in the classroom show at least 
a modest level of achievement gain over students 
who do not use computers. Clearly, the extent of 
teachers’ computer training and their level of prep- 
aration in using computers in education will vary 
and thus affect the level of success of computer- 
aided instruction. 



9. See, for example, Shousan Wang and Phillip J. Sleeman, “Computer-Assisted Instruction Effectiveness. . .A Brief Review 
of the Research,” International Journal of Instructional Media, Vol. 20 (1993), pp. 333-348, and Claire M. Fletcher-Flinn 
and Breon Gravatt, “The Efficacy of Computer Assisted Instruction (CAI): A Meta-Analysis,” Journal of Educational 
Computing Research, Vol. 12 (1995), pp. 219-242. 
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